Wireless multimedia content brokerage service for real time selective content provisioning

ABSTRACT

A wireless multimedia content brokerage service can provide for real time selective content extraction in a manner that allows users to easily obtain, at a mobile device, one or more portions of a real time multimedia composite content presentation. The brokerage service ensures that the experience is transparent from the point of view of the user, and additionally does not require any specific interaction between the user and the display, or interaction between the user and the content service provider (or providers). Instead, the brokerage service handles the transactional details involved in subscribing to content and in obtaining, formatting, and forwarding content to the mobile device. Additionally, since the content of interest is not forwarded from the display itself and since some embodiments of the system do not rely on any interactivity at the display to identify the display device or content, relatively unsophisticated display devices can be used.

CROSS-REFERENCE TO RELATED APPLICATION

The present application is a continuation of U.S. patent applicationSer. No. 13/601,172, filed on Aug. 31, 2012, which was a continuation ofU.S. Pat. No. 8,261,307, which issued on Sep. 4, 2012, the disclosuresof which are hereby incorporated by reference in their entirety.

BACKGROUND

Hand held personal mobile terminals, such as cellular telephones, arebecoming the constant companion of contemporary individuals who mayencounter real time multimedia content numerous times a day. Forexample, a person may encounter multimedia content at an airport orother waiting room, at a cafeteria or restaurant, in a lounge, or suchas at a hotel. Some of this publicly-viewable content may comprise realtime broadcasts provided via large display devices and/or other displaydevices. In some instances, public or other display devices viewed by anindividual may present composite multimedia presentations. Generally, acomposite multimedia presentation can comprise multiple simultaneousstreams of content. As an example, a single large display may featuremultiple video streams which may or may not include accompanying audio.

An individual viewing content (referred to herein also as a “user”) maydesire to continue to view real time content, but may have any number ofreasons to leave the area in which the display device can be perceived.Accordingly, the user may wish to view some or all of the content on amobile device. If an entire composite multimedia presentation is simplymirrored on the mobile device, the content of the composite multimediapresentation may be difficult or impossible to fully view due to smallscreen size and/or low resolution of the mobile device. Furthermore,existing systems, such as video on demand systems, require effort on thepart of the mobile user to locate the applicable content provider and,in some instances, to obtain a subscription or to perform other rightsmanagement activity before actually viewing the content. Thus,opportunities remain to improve the experience for users of mobiledevices, such as by providing for partial content extraction onto adevice.

SUMMARY

In accordance with some aspects of the present subject matter, awireless multimedia content brokerage service can provide for real timeselective content extraction in a manner that allows users to easilyobtain, at a mobile device, one or more portions of a real timecomposite multimedia presentation. The brokerage service ensures thatthe experience is transparent from the point of view of the user, andadditionally does not require any specific interaction between the userand the display, or interaction between the user and the content serviceprovider (or providers). Instead, the brokerage service handles thetransactional details involved in obtaining subscriptions to content andin obtaining, formatting, and forwarding content to the mobile device.Additionally, since the content of interest is not forwarded from thedisplay itself and since some embodiments of the system do not rely onany interactivity at the display to identify the display device orcontent, relatively unsophisticated display devices can be used.Furthermore, the user is not limited to proximity to a particulardisplay device since the display device does not need to play a role inthe transfer of content data to the mobile device.

A wireless multimedia content brokerage system can comprise at least onecomputing device (referred to as a “brokerage computing device” forclarity) adapted to access presentation identification data thatidentifies a realtime composite multimedia content presentation. Forexample, the composite multimedia content presentation can comprise aplurality of content streams, such as a plurality of real time videocontent streams and one or more audio feeds. The particular manner inwhich the streams are provided to and by a display device does notmatter. For instance, in some embodiments, a display device may receivea single data stream comprising the plurality of multimedia components.In other embodiments, the display device may receive several streams andcombine the streams into a composite presentation at the display device.

The at least one brokerage computing device can be adapted to identifyat least one content provider associated with the plurality of streams.For instance, in some embodiments, a single content provider assemblesand provides the composite content presentation. However, in otherembodiments, a composite content presentation may be assembled fromstreams provided by multiple content providers. In any event, thecontent provider(s) can be identified in any suitable way. For instance,a mobile device user may provide a suitable identifier, such as adisplay SIP or IP address, a content identifier (such as an indicationof a channel, content provider, or content title or reference number),or the like via an interface that relays the information to the at leastone brokerage computing device. Based on the display device SIP/IPaddress, content identifier, and/or other relevant information, the atleast one brokerage computing device can cross-reference the contentprovider(s) for the presentation to determine what media stream(s)comprise the underlying components of the composite presentation andwhere to obtain the streams.

For example, if a composite presentation comprises a ticker, a feed ofgraphics (e.g. a graphical weather forecast), and a video feed of anewscaster, each such component may be made available by the contentprovider(s) as an individualized stream. The individualized streams maybe made available even if the composite presentation is sent as a singlestream (e.g. as a single broadcast or cable channel).

The at least one brokerage computing device can be adapted to accessdata comprising the plurality of streams made available by the contentprovider(s) and, in some embodiments, to buffer the accessed data. Forexample, if the content provider(s) push content, the at least onebrokerage computing device can issue one or more suitable push requestsand receive and buffer the content. Additionally, the at least onebrokerage computing device can provide selection interface data to auser's mobile device and access selection data provided by the mobiledevice, with the selection data identifying at least one of theplurality of streams for extraction to the mobile device. The brokeragecomputing device(s) can further be adapted to transmit the buffered datacomprising the at least one identified stream to the mobile device.

In some embodiments, the brokerage computing device(s) may be adapted toavoid buffering accessed data comprising at least one stream that is notidentified in the selection data. For example, if a composite multimediapresentation comprises numerous video streams and a particular userelects to view only one stream, the brokerage service can discontinuebuffering the other streams. However, in some embodiments, the brokerageservice retains sufficient information for a user to revert back to theselection phase and select other streams. Further, buffering maycontinue if other users served by the brokerage computing device(s)continue to view the same stream. In some embodiments, the brokeragecomputing device or devices may not buffer content, but may instead actas a pass-through between the mobile device and the content provider(s).

In some embodiments, the least one brokerage computing device may alsobe adapted to interface with the at least one content provider and, inresponse to the selection data provided by the mobile device, transmitdata identifying at least one change in the display. For example, themobile device may provide selection data indicating a particular portionor portions of the composite media stream as selected by the mobiledevice user. Based on the selection data, the at least one brokeragecomputing device can send data to the appropriate content provider, andthe content provider can highlight or otherwise annotate the selectedportion(s) at the large display device. Accordingly, a mobile deviceuser can receive feedback provided through a large (or other) displaydevice in selecting which portion or portions to view at the mobiledevice. Data defining the annotation(s) or highlight(s) may be includedin data comprising the media sent to the large display device, or maycomprise data sent as separate commands to the display device or otherrelated components such as, e.g. a set-top box associated with thedisplay device.

It should be noted that, although in accordance with some aspects of thepresent subject matter a display can appear to be responsive to a user,the present subject matter does not require any sort of specific datatransfer with or between the display and the user device. Thus, thepresent subject matter can be used with displays without requiringspecialized functionality to support sending content to mobile devices.

In some embodiments, the selection interface data comprises datadefining the layout of a graphical user interface, with the graphicaluser interface comprising respective portions corresponding to locationsof various streams in the composite multimedia presentation. Forexample, the graphical user interface may be presented at the mobiledevice based on the selection interface data so that a scaled replica ofthe large display is presented at the mobile device. A mobile deviceuser may then navigate through the graphical user interface to identifyone or more portions of the composite multimedia display. The individualstreams may be represented as still images in some embodiments.

In some embodiments, the brokerage computing device can be furtheradapted to determine whether one or more subscriptions are needed toaccess the plurality of streams and, if so, obtain the neededsubscription or subscriptions. For instance, prior to accessing datacomprising the streams, a database or other suitable set of informationcan be accessed to determine if a subscription is needed to access thestream and whether or not such a subscription is available. For contentwhich is not subscription-based, other actions can be taken to ensurethat the computing device has sufficient rights to obtain and providethe content stream(s) to the mobile device. The present subject matteris not limited by the particular type(s) of rights clearance stepsrequired to access content, and can even be used with regard to contentthat requires no rights management.

In some embodiments, the at least one brokerage computing device can beadapted to interface with at least one content provider afteridentifying the content provider and obtain at least one structured datafile identifying a network address for each of the plurality of contentstreams comprising the content display. Further, in some embodiments,the structured so data file may also comprise data identifying thespatial arrangement of the composite media display. The at least onebrokerage computing device may be adapted to generate the selectioninterface data based on the structured data file. As an example, acontent provider may make one or more structured files such as XML filesavailable and cross-referenced to specific display devices by displaydevice SIP/IP address or other identifier(s). The XML files may specifya network address, such as a SIP/IP address and/or other identifier(s),for each component of the composite media display provided at thedisplay device.

In some embodiments, the brokerage computing devices can be adapted toaccess presentation identification data and identify at least onecontent provider as part of a partial content service session. Thebrokerage device(s) may further be adapted to determine the location ofthe mobile device and, based on the location of the mobile device andthe identity of the content provider, determine whether a transfer ofthe partial content service session to a mirror brokerage device isneeded. Accordingly, in some embodiments, the system can comprisemultiple brokerage computing devices, at least one of which isconfigured to selectively act as a mirror device. In handing aparticular session, the brokerage device(s) configured as a mirrordevice can then access selection data, access data comprising theplurality of streams, buffer the data, and transmit the buffered data tothe mobile device in response to a transfer of the partial contentextraction session from a different brokerage computing device.

BRIEF DESCRIPTION OF THE DRAWINGS

A full and enabling disclosure including the best mode of practicing theappended claims and directed to one of ordinary skill in the art is setforth more particularly in the remainder of the specification. Thespecification makes reference to the appended figures, in which:

FIG. 1 is a block diagram showing an overview of an exemplarycommunications system comprising a wireless multimedia content brokerageservice that supports partial content extraction to mobile devices;

FIG. 2 is a flowchart showing exemplary steps in a high-level processfor providing wireless multimedia content brokerage services;

FIG. 3 is a block diagram showing aspects of an exemplary wirelessmultimedia content brokerage service in closer detail;

FIG. 4 is a block diagram showing another exemplary communication systemcomprising a wireless multimedia content brokerage service;

FIG. 5 is a flowchart showing steps in an exemplary process for servicemanagement by a brokerage agent, including assigning an appropriatemirror agent when needed; and

FIG. 6 is a flowchart showing steps in an exemplary process which may becarried out by a wireless multimedia content brokerage service insupport of provisioning partial content.

Use of like reference numerals is intended to illustrate like oranalogous components.

DETAILED DESCRIPTION

Reference will now be made in detail to various and alternativeexemplary embodiments and to the accompanying drawings, with likenumerals representing substantially identical structural elements. Eachexample is provided by way of explanation, and not as a limitation. Infact, it will be apparent to those skilled in the art that modificationsand variations can be made without departing from the scope or spirit ofthe disclosure and claims. For instance, features illustrated ordescribed as part of one embodiment may be used on another embodiment toyield a still further embodiment. Thus, it is intended that the presentdisclosure includes modifications and variations as come within thescope of the appended claims and their equivalents.

The technology discussed herein makes reference to servers, databases,software applications, and other computer-based systems, as well asactions taken and information sent to and from such systems. One ofordinary skill in the art will recognize that the inherent flexibilityof computer-based systems allows for a great variety of possibleconfigurations, combinations, and divisions of tasks and functionalitybetween and among components. For instance, server processes discussedherein may be implemented using a single server or multiple serversworking in combination. Databases and applications may be implemented ona single system or distributed across multiple systems. Distributedcomponents may operate sequentially or in parallel.

When data is obtained or accessed between a first and second computersystem or component thereof, the actual data may travel between thesystems directly or indirectly. For example, if a first computeraccesses a file or data from a second computer, the access may involveone or more intermediary computers, proxies, and the like. The actualfile or data may move between the computers, or one computer may providea pointer or metafile that the second computer uses to access the actualdata from a computer other than the first computer, for instance.

The various computer systems discussed herein are not limited to anyparticular hardware architecture or configuration. Embodiments of themethods and systems set forth herein may be implemented by one or moregeneral-purpose or customized computing devices adapted in any suitablemanner to provide desired functionality. The device(s) may be adapted toprovide additional functionality complementary or unrelated to thepresent subject matter, as well. For instance, one or more computingdevices may be adapted to provide desired functionality by accessingsoftware instructions rendered in a computer-readable form. Whensoftware is used, any suitable programming, scripting, or other type oflanguage or combinations of languages may be used to implement theteachings contained herein. However, software need not be usedexclusively, or at all. For example, some embodiments of the methods andsystems set forth herein may also be implemented by hard-wired logic orother circuitry, including, but not limited to application-specificcircuits. Of course, combinations of computer-executed software andhard-wired logic or other circuitry may be suitable, as well.

Embodiments of the methods disclosed herein may be executed by one ormore suitable computing devices. For instance, as noted in furtherdetail below, a communications system may comprise one or more systemsthat can provide wireless multimedia content brokerage services. Suchsystem(s) may comprise one or more computing devices adapted to performone or more embodiments of the methods disclosed herein. As noted above,such devices may access one or more computer-readable media that embodycomputer-readable instructions which, when executed by at least onecomputer, cause the at least one computer to implement one or moreembodiments of the methods of the present subject matter. Additionallyor alternatively, the computing device(s) may comprise circuitry thatrenders the device(s) operative to implement one or more of the methodsof the present subject matter. Furthermore, components of thepresently-disclosed technology, such as subscriber databases, may beimplemented using one or more computer-readable media.

Any suitable computer-readable medium or media may be used to implementor practice the presently-disclosed subject matter, including, but notlimited to, diskettes, drives, and other magnetic-based storage media,optical storage media, including disks (including CD-ROMS, DVD-ROMS, andvariants thereof), flash, RAM, ROM, and other memory devices, and thelike.

Software agents are utilized in some embodiments of the present subjectmatter. Generally speaking, any type of software agent may be used, withthe actions of the software agent based on rules, parameters, profiles,and other data provided by the agent's principal or principals, i.e.,the individual(s), group(s), or other entity (or entities) configuringthe agent's behavior. The degree of autonomy exercised by the agent mayvary, and may depend on rules or preferences specified by the agent'sprincipal. In some instances, the rules may provide for the agent tocontact one or more persons and/or other agents for additional data,such as confirmation of a course of action or further informationrequired by the agent to evaluate a situation. Agent functionality maybe handled by a single agent or coordinated amongst multiple agents.Agent(s) may reside in one computing device or may be distributedamongst multiple computing devices. No particular level of autonomy or“intelligence” is required of a software agent; for instance, in someembodiments, the term “software agent” can refer to a routine or acollection of routines that provide particular functionality.

The present disclosure also makes reference to the relay of communicateddata over one or more communications networks. It should be appreciatedthat network communications can comprise sending and/or receivinginformation over one or more networks of various forms. For example, anetwork can comprise a dial-in network, a local area network (LAN), widearea network (WAN), public switched telephone network (PSTN), theInternet, Intranet or other type(s) of networks. A network may compriseany number and/or combination of hard-wired, wireless, or othercommunication links. Although several examples herein relate to anIMS-complaint network, in other embodiments, the subject matter may beimplemented as part of a network (or networks) based on other public orproprietary standards.

FIG. 1 is a block diagram showing components in an exemplarycommunications system 10 that includes a wireless multimedia contentbrokerage service that includes support for partial/selective extractionof content displays provided via one or more large display devices andforwarding of such content to mobile devices. In this example, theservice is provided by way of one or more application servers 12 and 12a, also labeled with exemplary SIP addresses “SIP AS-1” and “SIP AS-2.”Each application server comprises one or more computing devices adaptedto provide a wireless content brokerage agent (WCBA) 14, 14 a. Forexample, a wireless content brokerage agent may comprise one or moreprocesses, applications, or software agents which receive requests forcontent extraction, manage incoming and outgoing media streams, andcoordinate transactional details, such as subscriptions and other rightsmanagement with regard to content. Although not discussed in detailherein, application servers such as 12 and 12 a may, in someembodiments, be adapted to provide other services/functionality.

Other aspects of exemplary communications system 10 comprise IMS corenetwork 22, which can comprise any all-IP telecom network that requireseach end element to have an IP address expressed in a SIP (SessionInitiation Protocol) format. IMS has been standardized by the Thirdgeneration Partnership Project (3GPP) and has been accepted by thetelecom world as the next generation telecom standard running on IPv6(Internet Protocol Version 6). Further, media streams can be transferredusing SIP/SDP/RTP protocol, which refers to Session InitiationProtocol/Session Description Protocol/Real Time Protocol.

Generally speaking, in some embodiments, application servers, such asservers 12, 12 a, and server 18 (discussed below) are in the servicelayer of IMS. Mobile terminals, such as exemplary mobile terminal 32,communicate with other mobile terminals, other devices in the IMSnetwork, and IMS services by way of IMS core network 22.

Although the full details of the IMS network are not explored herein,FIG. 1 further illustrates several elements as generalized blockdiagrams. Namely, the home subscription server/database (HSS) 24, callsession control function (CSCF) 26, border functions (BF) 28, and mediafunctions (MF) 30 are identified for sake of completeness. Briefly, HSS24 serves as a clearinghouse for data regarding various devices in theIMS network, such as user or device profiles. CSCF 26 provides for callsession control functions governing telephone and other communicationsfunctionality. Border Functions 28 handle communication betweendifferent IMS core networks, while media functions 30 process ormanipulate multimedia for optimal transit through the network.

Content service provider 18 comprises any entity which, via one or morecomputing devices, makes multimedia content available to consumers viathe IMS network 22. For instance, multimedia content displays can beprovided via one or more large display devices viewable in public orother areas. In other embodiments, content service provider 18 mayadditionally or alternatively provide content without the use of an IMSnetwork. For instance, the present subject matter can be implemented ina system using broadband data communication standards other than IMS,such as an IP-based distribution system accessible by a wireless serviceprovider. Additionally, multiple network types may be used. Forinstance, content may be made available to display devices through onetype of network, such as a broadcast or cable television network, whileidentification of displays, communications with mobile devices, andstreaming of components occur over another network, such as a cellulartelephone network and/or wireless Internet.

Although several examples herein relate to multimedia content presentedvia a large display device, it is to be understood that the presentsubject matter is not intended to be limited to particular types ofcontent or particular mode or manner of presentation. For example, othercontent presentation systems may provide 3-D content (with or withoutaudio). Furthermore, the display need not be large or public. Forinstance, a user may view a composite content presentation at a friend'shome or other private setting at a small screen (e.g. television,computer screen) and extract partial content using embodiments of thepresent subject matter.

Returning to exemplary application server 12, the wireless contentbrokerage agent 14 provided via server 12 communicates with one or moremobile users to ascertain each user's media extraction requirements andarranges for multimedia flow from the appropriate content serviceprovider or providers, such as content service provider 18. Namely,wireless content brokerage agents such as 14 can obtain content directlyfrom content service providers, such as 18, and provide the content in asuitable form to mobile terminals, such as terminal 32. Accordingly, norights management or other transactional details need to be handleddirectly by the user at mobile 32 for a particular content extractionsession. Additionally, no interaction between the user and displaydevice is required. Thus, relatively “dumb” large display devices can beused. In other embodiments the extraction experience can be enhancedthrough support of some interactivity/data transfer at the large displaydevice, but this is not required.

Additionally, the “home” wireless content brokerage agent (14 in thisexample) is responsible for maintaining a content service providerdatabase 16 that references major contents service providers known tosupply multimedia content to public display devices. Database 16 can beused to determine when a mirror application server should be utilizedfor best service quality.

For instance, content service providers may service different geographicregions and may even be dispersed across continents. Thus, one or moremirror content brokerage services can be provided so that it is notnecessary for content to be routed over excessive distances. Instead,local content from local content service providers can be routed throughlocal mirror wireless service provider application servers. In thisexample, application server 12 a and content brokerage agent 14 acomprise a “mirror” service/agent supporting a different area thanserver 12 and agent 14. For example, when a user of mobile terminal 32is far from his home network, such as on another continent, content maybe routed through server 12 a rather than through home server 12.

Generally, the user can associate with a given wireless service providerand obtain a subscription to the partial content extraction service. Thepartial content extraction service, for example, may be provided by theuser's communications carrier (e.g. cell phone company) or may be aseparate service provided by one or more third parties. In any event,the wireless service provider affiliates with content providers such ascontent service provider 18 in order to obtain sufficient rights toretrieve and forward selected content to mobile device 32. For example,the wireless service provider may proactively or on a case-by-case basisobtain subscriptions to content service providers based on the locationof mobile device 32. Additionally or alternatively, content brokerageagent 14 may engage in other rights clearance activities other thanobtaining subscriptions.

FIG. 2 provides a high-level conceptual overview of some aspects of thepresent subject matter by illustrating exemplary steps in a process 50for providing partial content provisioning via a wireless multimediacontent brokerage service. Additionally, the exemplary steps of FIG. 2are cross-referenced by letters to exemplary communications shown inFIG. 1 and identified by capital letters A through E.

At step 52, the home wireless service provider maintains information onsubscribing mobile users, content service providers, and wirelessservice provider mirror servers. For instance, the information can bearranged and/or accessed by algorithms, processes, or applications thatare configured to determine the optimal component combinations forserving users based on location. As shown at (A) in FIG. 1, server 12 isin communication with terminal 32 to determine the location of terminal32. Location may be tracked in any suitable manner, such as bygeographic coordinates (e.g., GPS) or network location (e.g. cell ID).Additionally, home wireless content brokerage agent 14 receives arequest from the user of terminal 32 identifying a composite multimediapresentation comprising content which the user of terminal 32 wishes tohave forwarded/routed to terminal 32.

At 54, based on the geographic (or other) location of the mobile user,the home wireless content brokerage agent 14 assigns an appropriatemirror site to service the mobile user. This is shown at (B) in FIG. 1,which represents one or more data transfers between server 12 and server12 a which serve to alert mirror WCBA 14 a that content extraction is tobe handled by wireless content brokerage agent 14 a. For example, theuser of mobile terminal 32 may be physically closer to server 12 arather than home server 12. As another example, such decisions may notdepend on the relative location of the mobile terminal relative to theserver, but instead may depend on the relative location of the server tothe content provider. Of course, other network factors may be consideredin addition to or instead of location.

At step 56, the assigned WCBA establishes a suitable connection with acontent service provider. For example, data provided by home server 12may indicate that content from content service provider 18 is to beforwarded to device 32. Accordingly, mirror WCBA 14 a may establish aSIP/SDP/RTP multimedia session with content service provider 18 andobtain extractable multimedia content component streams. This is shownat (C) in FIG. 1. Briefly, (C′) in FIG. 1 shows the connection thatwould be made between content service provider 18 and home server 12 if,for example, terminal 32 were to be served via home server 12/home WCBA14.

As will be discussed in further detail below, the wireless multimediacontent brokerage service can interface with mobile terminal 32 toreceive selection data from a user. The selection data can identify oneor more of a plurality of multimedia streams displayed in a compositemultimedia presentation which are of interest to the user. For example,the content brokerage agent 14 a can generate a graphical user interfacethat enables the mobile terminal user to navigate through arepresentation of a large display to indicate one or more streams ofinterest. If home agent 14 were handing the entire session, then homeagent 14 would generate the graphical user interface.

As shown at 58, based on the selection data provided by the mobile user,the wireless content brokerage agent sends the selected stream orstreams to the mobile terminal. In FIG. 1, this is shown at (D). If homeserver 12/home agent 14 were serving terminal 32, then the content wouldflow over the same path as (A), although it will be understood that themultimedia flow can be entirely separate from the initial request.

In step 60 shown in FIG. 2, the mobile user selected multimedia contentcomponent streams continue to flow to the mobile terminal via one ormore SIP/SDP/RTP multimedia sessions established between the contentservice provider and content brokerage agent, and between the contentbrokerage agent and the terminal. The streams can continue until anysuitable end event, such as termination command by the user of terminal32, the end of the multimedia content stream, or other considerations.

FIG. 3 is a block diagram showing a closer view of an exemplaryapplication server 12. Also, in this example, application server 12further comprises content service provider database 16. Specifically,database 16 comprises table 40 that comprises a listing of contentservice providers, mirror sites, and other applicable information bygeographic location. Table 40, and any other databases or datasetsdiscussed herein, can be provided by any number or type of databases inany suitable logical or physical format.

As was noted earlier, wireless content brokerage agent 14 accessesdatabase 16 in order to determine optimal handling of partial contentextraction and forwarding. Also, in this example, content brokerageagent comprises a service manager component 34 which handlesinitialization of content extraction sessions and a content managercomponent 36 which handles accessing and buffering content, generatingselection interfaces, receiving selection data, and buffering andforwarding content to users. Thus, content manager component 36 may beused to handle sessions initiated by service manager component 34 and tohandle incoming sessions where application server 12 and agent 14 act asa mirror for other servers/agents.

For instance, in this example, service manager 34 accesses database 16and, as needed, handles contacting and interacting with mirror serviceproviders and/or content providers. For instance, by referencing homesubscriber service 24, service manager 34 may determine the location ofmobile users and thereby make effective use of CSP database 16. Inembodiments which do not utilize IMS, another suitable source ofinformation as to the location of mobile users can be used rather thanHSS 24.

Several other details illustrated in FIG. 3 relate to when contentbrokerage server 12 is handling media extraction and forwarding tomobile devices without use of a mirror server. For instance, a contentmanager 36 may utilize one or more buffers 38 a, 38 b, 38 c, and 38 d tobuffer incoming content during the interval between a forwarding requestand the actual provision of multimedia content to a mobile device. Forexample, one buffer may be used for each of a plurality of media streamsthat comprise a composite multimedia presentation of multimedia content.Although four buffers are shown in this example, it will be understoodthat an application server may have access to more or fewer buffers inorder to adequately service a desired number of mobile users.Furthermore, in some embodiments, buffer(s) used for a particularmultimedia content stream may be used to provide data for multipleusers. The particular portion of content extracted from the buffer maydiffer between users in such cases. Any suitable type of hardware and/orsoftware-based buffering schemes can be used. Still further, in otherembodiments, no buffering is performed, and content manager 36 providesa pass-through functionality (although some buffering may be incidentalto the pass-through functionality).

In this example, service manager 34 can access a dynamic table ofavailable content streams 19 to determine particular media streamaddresses to access. For example, as will be discussed below, acomposite multimedia presentation may comprise media from severaldifferent feeds. When a user identifies a particular display, several orall of the streams comprising the composite multimedia presentation canbe accessed via their respective network addresses and can be bufferedin a respective buffer. The user can then be prompted to select one ormore streams of Interest. Once the stream(s) of interest are identified,the buffered content can be forwarded to the user.

FIG. 4 provides a more detailed view of an exemplary communicationssystem 100 comprising a wireless multimedia content brokerage servicewith support for partial content extraction. This example also depictsan exemplary user 101 associated with mobile device 132, with user 101coming within perceptible range of a public fixed display device 102.Although the term “public” is used, the particular conditions requiredto view display device (or lack of such conditions) can vary. Forexample, a “public” display can comprise any display that can be viewedby one or more users, and may vary in size. Furthermore, the “displaydevice” can comprise not only the screen, projection, and/or otherequipment used to render a perceptible image, but additional componentsused to receive signals, such as one or more computing devices such as aset-top box (whether a separate component or integrated with othercomponents) and the like. Furthermore, the “display” can includeancillary components not related to visual aspects of the presentation,such as speakers for audio content.

As shown in the inset, public display device 102 provides a compositemultimedia presentation of several different multimedia real-timecontent streams. Namely, in this example, the display comprises anewscaster 103, graphical weather forecast 104, news clip 105, scrollingstock ticker 106, and scrolling news ticker 107. User 101 may wish toview some components on mobile device 132, but it may not be feasiblefor all components to be displayed on the screen of mobile device 132.For instance, the screen may be too small to show all components, or thebandwidth requirements for viewing all streams may be too excessive.Thus, in accordance with the present subject matter, user 101 canrequest for partial content extraction of the content displayed atdevice 102.

The remaining components illustrated in FIG. 4 are generally analogousto components with similar numbers shown in FIGS. 2-3. For instance,home application server 112 comprises home content brokerage agent 114with access to database 116 in the same manner as home server 12comprises home content brokerage agent 14 with access to database 16.Accordingly, mirror server 112 a, mirror content brokerage agent 114 a,home subscriber server (HSS) 124, IMS core network 122, content serviceprovider 118, multimedia content source 120, multimedia contentcomponent table 119, and are not discussed in further detail. IMS callsupport components are generally illustrated at 126 and may comprise,for instance, P-CSCF, I-CSCF, and S-CSCF.

Exemplary operation of a wireless multimedia content brokerage systemsuch as the one shown in network 100 will now be discussed inconjunction with FIGS. 5 and 6, which each illustrate steps in exemplaryprocesses for operating such a service. Additionally, in a laterexample, reference will be made to communications occurring betweencomponents shown in FIG. 4 and labeled 201 through 222.

FIG. 5 shows an exemplary process 70 comprising steps related to servicemanagement aspects of a wireless content brokerage agent. Step 72represents an initial state, where a wireless content brokerage agenthas access to a database of content service providers in geographic (orother) locations which the content brokerage agent commits to providecontent extraction and forwarding services. Each home content brokerageagent also has access to a list of mirror service sites located in thecommitted geographic locations. Although several examples herein relateto content brokerage services supporting mirroring, in otherembodiments, all requests can be handled by the home agent. Accordingly,mirroring-related functionality could be omitted.

Step 74 represents an initial setup step between a wireless device userand the content brokerage agent, wherein the user obtains a subscriptionfrom the wireless service provider for selective content extractionservices. As was noted above, this service may be provided as a featurein a calling plan or other arrangement between a wireless serviceprovider and a user, or may be provided as a third party service.

The home content brokerage agent updates the mobile user's profile inthe home subscription database identifying the wireless service provideras the mobile user's home provider. In embodiments in which the contentbrokerage service is implemented as part of an IMS core network, such asnetwork 122, such a profile update is necessary for authorizing anS-CSCF component of the core network to establish a SIP/SDP/RTP sessionbetween the content brokerage agent and the mobile terminal.

Step 76 represents service management activities that may be performedat some point after a user has subscribed or otherwise obtained theservices of the wireless multimedia content brokerage system. Forinstance, a user may set up the content forwarding service sometimeprior to encountering content, or may be prompted to subscribe to thecontent forwarding service at the time the user encounters content. Atstep 76 a mobile user, such as user 101 in FIG. 4, comes into thevicinity of fixed display device 102 and logs onto the user's homecontent brokerage service by contacting a brokerage agent to launch thecontent extraction service. For example, the home brokerage agent canverify authentication for the content extraction service by checking thehome subscriber database.

At step 78, the home content brokerage agent obtains informationregarding the mobile user's current geographic or other location. Thisinformation may be obtained, for example, from the home subscriberservice so database in implementations in a system supporting IMSfunctionality. Based on identification data provided by the user, thebrokerage agent can determine the geographic or other location of thecontent provider for the display device of interest. As shown at 80, thehome content brokerage agent uses its content service provider database116 to determine which mirror content brokerage agent (if any) would bebest suited for servicing the mobile user for the particular contentextraction service. As shown at 82, if a home content brokerage agent issuitable for providing the content extraction service, process 70 skipsto step 86. However, if the home content brokerage agent determines thatanother agent would be more appropriate, then as shown at 84, the homeagent transfers the mobile user's web session to an appropriate mirrorcontent brokerage agent. For instance, as was noted earlier, a useroutside the geographic region served by the home content brokerage agentmay be better served by a local brokerage agent with a closer or morerobust connection to corresponding local content service providers.

As shown at 86, the home content brokerage agent which is handling themobile user session returns a web page (or other suitable interface) tothe user that can be used to send a request to the appropriate contentbrokerage agent to launch the content extraction service. The contentbrokerage agent which receives the request can then provide a suitablerepresentation of the fixed display multimedia content for furtherselection by the user. As shown at 88, the mobile user provides dataindicating a launch, such as pressing a content extraction servicelaunch button, selecting a launch command using an interface on thephone, or in any other suitable manner. At this point, a contentmanagement session begins between the assigned content brokerage agentand the mobile terminal. If no mirror agent is used, then the contentmanagement session is also handled by the home content brokerage agent.

FIG. 6 illustrates steps in an exemplary content management session 150between a wireless content brokerage agent and a mobile terminal. Step152 represents an initial state wherein a user request for launching amultimedia content extraction session has arrived at an assigned contentbrokerage agent. The agent has access to a dynamic multimedia componenttable showing which multimedia content components of a particulardisplay of interest are extractable in real time. For example, in someinstances, a public display device may comprise a composite mediadisplay that includes elements which are not extractable. The componenttable may include a place holder or other indication so that the contentbrokerage agent can inform the mobile user of which content streams areavailable.

At 154, the content brokerage agent obtains a subscription as a user ofthe target content service provider. For instance, the content serviceprovider may also use the home subscription server database of the IMSnetwork to manage authorization for obtaining content. In suchembodiments, the content service provider can update a user profilecorresponding to the content brokerage agent to ensure authorization tothe IMS components when required. At 156, the content brokerage agentaccesses the multimedia component table for the identified contentservice provider to determine the number and characteristics ofcommunication sessions which are needed in order to obtain contentcomprising the composite multimedia presentation. For example, thecontent brokerage agent may determine which particular SIP/SDP/RTPsessions are required to access the data comprising the streams ofinterest. At 158, the content brokerage agent establishes the requiredconnections, such as an SIP/SDP/RTP multimedia session for eachcomponent stream of the content display.

At 160, the content brokerage agent extracts a thumbnail image of eachmultimedia stream incoming from the content service provider. At 162,the thumbnail images are inserted into a web page. This web page can bereturned to the mobile device as part of a graphical user interface forthe mobile user. For instance, the mobile user can navigate through areplica of the composite multimedia presentation in order to provideselection data to the content brokerage agent. For example, the imagesmay be placed into the webpage that is returned to the user in responseto launching the service as noted at step 88 in FIG. 5. Of course, thegraphical user interface need not necessarily comprise a web page, andother data formats/protocols could be used to provide the graphical userinterface.

At 164, the content brokerage agent receives the user's selection ofmultimedia components for extraction. At 166, the content brokerageagent establishes an SIP/SDP/RTP multimedia streaming session with themobile terminal and sends the requested mobile streams to the terminal.

In some embodiments, during the time between initial identification ofthe display and the time at which the content brokerage agent beginsstreaming to the mobile device, the content brokerage agent may bufferincoming content streams. In such embodiments, the streaming sessions tothe user terminal may begin at the earliest point in the buffer so thatthe recipient can avoid missing any portions of the content of interest.In other embodiments, the multimedia content may be mirrored at thedevice in real time or near real time, with or without buffering at thecontent brokerage agent. For instance, in some embodiments, thebrokerage agent acts as a pass-through only (although some incidental‘buffering’ may occur during the pass-through operations).

In this example, at 168 the content brokerage agent terminates theSIP/SDP/RTP multimedia sessions of component streams that are notselected by the mobile user. However, depending upon how the system isoptimized and otherwise configured, then buffering may not bediscontinued. For instance, if an agent is providing the same content tomultiple users, the data may be maintained in a shared buffer which iscontinually updated until no more users are accessing the content. At170, the selected component streams continue to play back in real timeat the mobile terminal. The component streams may continue until the endof the particular multimedia content in the streams and/or anothertermination event, such as termination of forwarding by the user.

Another example of content and service management steps and datatransfers which can occur in a system that includes a content brokerageservice will now be discussed in conjunction with FIG. 4. The followingso example explores additional detail while following a flow pathsimilar to the previous example discussed above. As shown at 200 in FIG.4, a content service provider, such as content service provider 118,obtains multimedia content 120 which is sent to a public fixed displaydevice 102. Multimedia content 120 may be obtained from any suitablesources, including stored data, live feeds, broadcast sources, and thelike.

As shown in the inset of FIG. 4, public fixed display device provides amultimedia display comprising a plurality of multimedia streams. Eachone of the streams 103-107 can comprise real time video content with orwithout accompanying audio. Additionally, as shown in FIG. 4 at 201, thecontent service provider 118 updates multimedia component table 119 toidentify the plurality of multimedia streams associated with displaydevice 102. For example, the data could be in the form of an XML filethat would be configured for a content brokerage agent to sort via astyle sheet associated with the XML file. The XML file may comprisecharacteristics identifying each partial content stream in a manner suchthat content brokerage agents can establish appropriate SIP/SDP/RTPsessions with the content service provider if required. In someembodiments, the XML file may contain the coordinates of the partialcontent on the display screen so that the content brokerage agent canprovide data to mobile users based on the special arrangement of contenton the public display.

As shown at 202, the home wireless service provider 112 obtains asubscription to content service provider 118. For example, thissubscription may be obtained in response to determining that user 101 isin a geographic or other location served by content service provider 118on large display devices. If service provider 112 already has anadequate subscription, then no subscription is needed. As shown at 203,the content service provider updates one or more home subscriptionserver database profiles to indicate that the wireless service providerand its brokerage agents (including the home and mirror contentbrokerage agents 114 and 114A) as authorized user of its multimediacontent. As shown at 204, the home content brokerage 114 maintains atable or other so suitable data mapping content service providers tosuitable mirror content brokerage agents. At 205, mobile user 101becomes a subscriber of the selective content extraction serviceprovided by the wireless multimedia content brokerage service. Contentbrokerage agent 114 updates the profile of user 101 in home subscriptionserver database 124.

As shown at 207, user 101 encounters a composite multimedia presentationcomprising a plurality of multimedia streams 103-107 provided via apublic fixed display device 102. The display may include one or morepublic service identifiers indicating the source of the content.Additionally, the display itself may include one or more indications ofits SIP address or other identifier(s). Although not required for thepresent subject matter, in some embodiments, the display includescommunication functionality, such as Bluetooth or Wi-Fi connectivity forautomatically providing its SIP address and/or content identifiers tointerested users.

As shown at 208, the mobile user launches a browser or other thin clientapplication on terminal 132 and logs onto home service provider 112 tobegin the multimedia content extraction service. The home contentbrokerage agent 114 authenticates user 101 by referencing subscriberdatabase 124 as shown at 209.

Home content brokerage agent 114 returns a mobile web page or othersuitable user interface data through which user 101 can use terminal 132to identify the content of interest as shown at 210. For example, theuser may be provided with a mobile web page for entering a publicservice identifier of the content service provider and/or the SIPaddress of the display device. If the display supports localcommunication, such data may be obtained from the display. However, itis emphasized that the display does not need to have any such datatransfer functionality, provided some sort of indication of the displayidentifier(s) is provided (e.g. a sign or panel). As shown at 211, thedata identifying the display device is sent to the home contentbrokerage agent. In some embodiments, no explicit identification of thedisplay is needed if the user can identify the content provider fromavailable information (e.g. a program title, channel identifier, or thelike).

As shown at 212, the home content brokerage agent determines the mobileuser's current geographic or other location from home subscriberdatabase 124. Also, as shown at 213, based on content provideridentification data (and/or display identification data) and thelocation of user 101/terminal. 132, the home content brokerage agent 114identifies an appropriate mirror content brokerage agent (114A in thisexample) suitable for serving terminal 132. As shown at 214, homecontent brokerage agent 114 informs the mirror content brokerage agent114A regarding the current extraction request. For example, 214 mayrepresent transfer of session data to agent 114A. As shown at 215, thehome content brokerage agent also updates user 101 profile with serviceauthorization for the mirror agent 114A. At 216, home content brokerageagent 114 returns a webpage or other suitable interface data whichallows user 101 to launch the content extraction service. In someembodiments, agent 114 may hand off the entire session to agent 114A,making agent 114A responsible for generating the launch webpage.

As shown at 217, the mobile user sends a request to launch the componentextraction service to the suitable content brokerage agent. In thisexample, the launch request is sent to mirror content brokerage agent114A, although if the home agent 114 was handling this particularsession, the request would be sent to the home agent. Mirror contentbrokerage agent 114 obtains multimedia component streams correspondingto those shown on display 102 by establishing SIP/SDP/RTP multimediasessions with content service provider 118 as shown at 218. Next, asshown at 219, mirror content brokerage agent 114A provides terminal 132with data so that terminal 132 can render an interface, such as a mobileterminal webpage, comprising thumbnail image representations of themultimedia component streams. The thumbnail images may be static in someembodiments, or may be updated at a reduced frame rate.

Although in the example above the content brokerage agent providedthumbnail representations of the content streams, in other embodiments,content service provider 118 may dynamically generate thumbnailrepresentations of its partial content streams and send therepresentations to content brokerage agents, such as part of or alongwith the XML or other files identifying the content streams.

As shown at 220, user 101 provides input to terminal 132 and terminal132 sends selection data to content brokerage agent 114A, such as via aHTTP request. In response, as shown at 221, mirror content brokerageagent 114A provides the selected multimedia component streams byestablishing one or more SIP/SDP/RTP multimedia sessions with terminal132. Mirror content brokerage agent 114A then terminates the unusedSIP/SDP/RTP session with content service provider 118 as shown at 222.User 101 can then view the requested stream(s) at terminal 132 until theend of the stream(s) or until another termination event occurs.

Several examples discussed above depict content provisioning in thecontext of a communication system configured in accordance with IMSstandards and principles. One of skill in the art will appreciate thatthe present subject matter does not rely on IMS and is not limited toIMS-compliant systems. For example, requests for content, responses torequests, and the content itself could be provided via other networktypes, such as broadband internet. Correspondingly, call routing,session requests, and the like need not be IMS-compliant. Subscriberdatabases and information may be maintained by a wireless serviceprovider in any suitable fashion, and not only using the HSS server.

The material particularly shown and described above is not meant to belimiting, but instead serves to show and teach various exemplaryimplementations of the present subject matter. As set forth in theattached claims, the scope of the present invention includes bothcombinations and sub-combinations of various features discussed herein,along with such variations and modifications as would occur to a personof skill in the art.

What is claimed:
 1. A multimedia content brokerage computing devicecomprising: memory; and circuitry associated with the memory, thecircuitry configured to: receive a request from a mobile device tolaunch an extraction service when the mobile device comes into vicinityof a device capable of receiving multimedia content component streams;determine a location of the mobile device; assign a server to providecontent to the mobile device based on the location of the mobile device;establish a connection with a content provider; obtain a plurality ofidentifiers for the multimedia content component streams; provide theplurality of identifiers to the mobile device; receive data from themobile device identifying one multimedia content component stream of themultimedia content component streams for extraction; obtain the onemultimedia content component stream from the content provider; andprovide the one multimedia content component stream associated withselection data to the mobile device.
 2. The device set forth in claim 1,wherein the multimedia content brokerage computing device is furtherconfigured to buffer at least one of the multimedia content componentstreams and to discontinue buffering accessed data comprising at leastone stream that is not identified in the selection data.
 3. The deviceset forth in claim 1, wherein the multimedia content brokerage computingdevice is further configured to: interface with the content providerand, in response to the selection data provided by the mobile device,transmit data identifying at least one change in the device capable ofreceiving multimedia content component streams.
 4. The device set forthin claim 1, wherein the multimedia content brokerage computing device isfurther configured to: determine whether one or more subscriptions areneeded to obtain the multimedia component streams and, if so, obtain theneeded subscription or subscriptions.
 5. The device set forth in claim1, wherein the multimedia content brokerage computing device is furtherconfigured to: after establishing a connection with the contentprovider, interface with the content provider and obtain at least onestructured data file identifying a network address for each of themultimedia content component streams.
 6. The device set forth in claim1, wherein the multimedia content brokerage computing device is furtherconfigured to: obtain a structured data file comprising data identifyinga spatial arrangement of a media presentation displayed on the devicecapable of receiving multimedia content component streams; and generatethe user interface based on the structured data file.
 7. The device setforth in claim 1, wherein the multimedia content brokerage computingdevice is further configured to: access presentation identification dataand identify at least one content provider as part of a partial contentservice session; and based on the location of the mobile device and anidentity of the content provider, determine whether to transfer thepartial content service session to a mirror brokerage computing device.8. The device set forth in claim 1 wherein the mirror brokeragecomputing device is configured to access the selection data, access datafor the multimedia content component streams, buffer the data, andtransmit the buffered data to the mobile device in response to atransfer of the partial content extraction session.
 9. A method ofproviding partial content extraction, the method comprising: receiving arequest from a mobile device to launch an extraction service when themobile device comes into vicinity of a device capable of receivingmultimedia content component streams; determining a location of themobile device; assigning a server to provide content to the mobiledevice based on the location of the mobile device; establishing aconnection with a content provider; obtaining a plurality of identifiersfor the multimedia content component streams; and providing theplurality of identifiers to the mobile device; receiving data from themobile device identifying one multimedia content component stream of themultimedia content component streams for extraction; obtaining the onemultimedia content component stream from the content provider; andproviding the one multimedia content component stream associated withselection data to the mobile device.
 10. The method set forth in claim9, further comprising buffering at least one of the multimedia contentcomponent streams and, after receiving the selection data, discontinuingbuffering at least one stream that is not identified in the selectiondata.
 11. The method set forth in claim 9, further comprising:interfacing with the content provider and, in response to the selectiondata provided by the mobile device, transmitting data identifying atleast one change in the device capable of receiving multimedia contentcomponent streams.
 12. The method set forth in claim 9, wherein the userinterface data defines a layout of a graphical user interface, thegraphical user interface comprising respective portions corresponding tothe one multimedia content component stream.
 13. The method set forth inclaim 9, further comprising: determining whether one or moresubscriptions are needed to obtain the multimedia component streams and,if so, obtaining the needed subscription or subscriptions.
 14. Themethod set forth in claim 9, further comprising: after establishing aconnection with the content provider, interfacing with the contentprovider and obtaining at least one structured data file identifying anetwork address for each of the multimedia component content streams.15. The method set forth in claim 14, further comprising: obtaining astructured data file comprising data identifying a spatial arrangementof a media presentation displayed on the device capable of receivingmultimedia content component streams; and generating the user selectioninterface based on the structured data file.
 16. The method set forth inclaim 14, further comprising: accessing access presentationidentification data; identifying at least one content provider for apartial content service session; and based on the location of the mobiledevice and an identity of the content provider, determining whether totransfer the partial content service session to a mirror brokeragecomputing device.
 17. A multimedia content brokerage computing devicecomprising: memory; and circuitry associated with the memory, thecircuitry configured to: receive a request from a mobile device tolaunch an extraction service when the mobile device comes into vicinityof a device capable of providing multimedia content component streams;determine a location of the mobile device; assign a server to providecontent to the mobile device based on the location of the mobile device;establish a connection with a content provider; obtain a plurality ofidentifiers for the multimedia content component streams; provide theplurality of identifiers to the mobile device in a web page; receivedata from the mobile device identifying one multimedia content componentstream of the multimedia content component streams for extraction;obtain the one multimedia content component stream from the contentprovider; and provide the one multimedia content component streamassociated with selection data to the mobile device.